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DETAILED ACTION 

1 . This application is responsive to application number (1 0/561 706) filed on June 2, 
2006. Claims 1-16 are pending and have been examined. 



Response to Arguments 

2. Applicant's arguments filed October 27, 201 0 have been fully considered but they 
are not persuasive. 

The applicant argues that Suzuki does not teach " wherein the control section 
finds the respective presentation end times of the video and the audio of the first data 
stream according to the time information added to the video data and the time 
information added to the audio data, and wherein if the presentation end time of the 
audio is later than that of the video, the control section stops outputting the audio from 
the presentation end time of the video through the presentation end time of the audio, 
wherein the control section finds the respective presentation start times of the video and 
the audio of the second data stream according to the time information added to the 
video data and the time information added to the audio data, and wherein if the 
presentation start time of the audio is earlier than that of the video, the control section 
stops outputting the audio from the presentation start time of the audio through the 
presentation start time of the video". The examiner respectfully disagrees. Suzuki 
teaches that a controller looks to the time information of the video data and the audio 
data to ensure that they are synchronized together (column 7 lines 1 - 10). 
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Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary sl<ill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill In the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

5. Claims 1 , 4-9, and 12-16 rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takamori et al (US 6,041 ,067, hereafter Takamori) in view of Suzuki (US 

5,808,722). 

As per claim 1, Takamori discloses a data processor for playing back video and 
audio from a data stream including video data and audio data, each of the video and 
audio data being provided with time information representing its presentation time, the 
data processor comprising: 
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an inserting section (Fig 9 element 701) for inserting boundary-setting dummy 
data into a data location where the first and second data streams switch each other 
(column 27 lines 9-20); 

an analyzing section (Fig 9 element 704), which detects the dummy data, 
assigns different pieces of identification information to the first and second data 
streams, and associates the Identification information with the video and audio data of 
each said data stream (column 27 lines 9 - 30); 

a control section (Fig 9 element 71 1) for controlling the respective output timings 
of video represented by video data and audio represented by audio data by reference to 
the time information of the video data and the time information of the audio data that are 

associated with the same piece of Identification information; and an output section for 
outputting the video and the audio at the output timings (column 27 lines 32 - 53). 

However, Takamorl does not explicitly teach a stream acquiring section for 
acquiring a first data stream and a second data stream continuously, wherein the 
control section finds the respective presentation end times of the video and the audio of 
the first data stream according to the time information added to the video data and the 
time Information added to the audio data, and wherein if the presentation end time of 
the audio Is later than that of the video, the control section stops outputting the audio 
from the presentation end time of the video through the presentation end time of the 
audio, wherein the control section finds the respective presentation start times of the 
video and the audio of the second data stream according to the time information added 
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to the video data and the time information added to the audio data, and wherein if the 
presentation start time of the audio is earlier than that of the video, the control section 
stops outputting the audio from the presentation start time of the audio through the 
presentation start time of the video. 

In the same field of endeavor, Suzuki teaches teach a stream acquiring section 
for acquiring a first data stream and a second data stream continuously (column 1 1 
lines 54 - 66), wherein the control section finds the respective presentation end times of 
the video and the audio of the first data stream according to the time information added 
to the video data and the time information added to the audio data, and wherein if the 
presentation end time of the audio is later than that of the video, the control section 
stops outputting the audio from the presentation end time of the video through the 
presentation end time of the audio (column 6 lines 25 - 67), wherein the control section 
finds the respective presentation start times of the video and the audio of the second 
data stream according to the time information added to the video data and the time 
information added to the audio data, and wherein if the presentation start time of the 
audio is earlier than that of the video, the control section stops outputting the audio from 
the presentation start time of the audio through the presentation start time of the video 
(column 6 lines 25 - 67 and column 7 lines 1 -1 0). 

Therefore, it would have been obvious for one having skill in the ordinary art at 

the time of the invention to modify the invention of Takamori in view of Suzuki. The 
advantage would be a means for efficient synchronization of the video and audio data. 
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As per claim 4, Takamori discloses the data processor of claim 1 , wherein when 
finding given video data and audio data associated with different pieces of identification 
information, the control section gets only the video represented by the video data output 
first, and wherein when finding video data, obtained after the video has been played 
back, and the audio data associated with the same piece of identification information, 
the control section controls the output timings of the video represented by the video 
data and the audio represented by the audio data in accordance with the time 
information of the video data and the time information of the audio data that are 
associated with the same piece of identification information (Fig 9 element 707; column 
27 lines 20 - 24 and column 38 - 47). 

As per claim 5, Takamori discloses the data processor of claim 1 , wherein the 
stream acquiring section is able to acquire three or more data streams continuously, 
and wherein the inserting section inserts dummy data, which has monotonically 
increasing or decreasing values corresponding to the identification information, into 
every data location where associated two of the continuously acquired data stream 
switch each other (Fig 9 element 707; column 27 lines 20 - 24 and column 38 - 47). 

As per claim 6, Takamori discloses the data processor of claim 5. 

However, Takamori does not explicitly teach wherein when finding the piece of 
identification information associated with the audio data agreeing with a piece of 
identification information associated with video data representing video that was output 
in the past, the control section stops outputting audio represented by the audio data and 
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starts outputting audio represented by audio data having the same piece of identification 
information as that associated with the video data of the video being output currently. 

In the same field of endeavor, Suzuki teaches wherein when finding the piece of 
identification information associated with the audio data agreeing with a piece of 
identification information associated with video data representing video that was output 
in the past, the control section stops outputting audio represented by the audio data and 
starts outputting audio represented by audio data having the same piece of identification 
information as that associated with the video data of the video being output currently 
(column 6 lines 25 - 67). 

Therefore, it would have been obvious for one having skill in the art at the time of 
the invention to modify the invention of Takamori in view of Suzuki. The advantage 
would be a means for efficient synchronization of the video and audio data. 

As per claim 7, Takamori discloses the data processor of claim 1 . 

However, Takamori does not explicitly teach wherein when; finding the piece of 
identification information associated with the audio data agreeing with a piece of 
identification information associated with video data representing video that has not 
been output yet, the control section stops outputting audio represented by the audio 
data and does not start outputting the audio represented by the audio data until the 
piece of identification information agrees with a piece of identification information 
associated with video data acquired afterward. 
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In the same field of endeavor, Suzuki teaches wherein when; finding the piece of 
identification information associated with the audio data agreeing with a piece of 
identification information associated with video data representing video that has not 
been output yet, the control section stops outputting audio represented by the audio 
data and does not start outputting the audio represented by the audio data until the 
piece of identification information agrees with a piece of identification information 
associated with video data acquired afterward (column 6 lines 25 - 67). 

Therefore, it would have been obvious for one having skill in the art at the time 
of the invention to modify the invention of Takamori in view of Suzuki. The advantage 
would be a means for efficient synchronization of the video and audio data. 

As per claim 8, Takamori discloses the data processor of claim 1 , wherein each 
said data stream has a packet structure including packets that store video data and 
packets that store audio data, and wherein the inserting section inserts the boundary- 
setting dummy packet between the last packet of the first data stream and the first 
packet of the second data stream (column 1 lines 48 - 52). 

Regarding claim 9, arguments analogous to those presented for claim 1 are 
applicable for claim 9. 

Regarding claim 10, arguments analogous to those presented for claim 2 are 
applicable for claim 10. 

Regarding claim 11, arguments analogous to those presented for claim 3 are 
applicable for claim 1 1 . 
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Regarding claim 12, arguments analogous to those presented for claim 4 are 
applicable for claim 12. 

Regarding claim 13, arguments analogous to those presented for claim 5 are 
applicable for claim 13. 

Regarding claim 14, arguments analogous to those presented for claim 6 are 
applicable for claim 14. 

Regarding claim 15, arguments analogous to those presented for claim 7 are 
applicable for claim 15. 

Regarding claim 16, arguments analogous to those presented for claim 8 are 
applicable for claim 16. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHIKAODILI E. ANYIKIRE whose telephone number is 
(571)270-1445. The examiner can normally be reached on Monday to Friday, 7:30 am 
to 5 pm, EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha D. Banks-Harold can be reached on (571) 272 - 7905. The fax 
phone number for the organization where this application or proceeding is assigned is 
571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Marsha D. Banks-Harold/ 

Supervisory Patent Examiner, Art Unit 2482 



/Chikaodili E Anyikire/ 
Examiner, Art Unit 2482 



